REMARKS 



This Preliminary Amendment is being submitted in order to further prosecution 
of this application. 

The specification and abstract are being amended to improve form in accordance 
with the Rules of Practice of the Patent and Trademark Office. Claims 1 thru 4 are 
being cancelled without prejudice or disclaimer, and new claims 5 thru 15 are being 
added. Thus, claims 5 thru 15 are pending in this application. 

In view of the above, it is submitted that this application is now in condition for 
examination on the merits, and early allowance and issuance thereof is solicited. If 
there are any questions relative to this application, it is requested that the Examiner 
contact the undersigned attorney at the below-listed local telephone number in order to 
expedite allowance of this application. 



Respectfully submitted. 



Janos FEKETE 




Joseph G. Seeber 
Reg. No. 27,219 



Post Office Box 750 
Great Falls, VA 22066 
Telephone: (703)430-1702 
Facsimile: (703)450-7914 
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MARKED UP COPY OF AMENDED SPECIFICATION 

[Device for aiding the orientation of the blind] 

Set of Equipment for Aiding the Orientation of the Blind 

[The invention relates to a device that aids the orientation of the blind, which contains a 
sensing unit that can be fixed to the body surface of the person using it and a processing unit 
that is connected to the sensing unit.] 

Technical Field 

The invention relates to a set of equipment to aid the orientation of the blind. The 
invention includes a device attached to a carrying unit that can be attached to the surface of the 
body and an input unit that can be connected to the device. The device has a sensing unit and 
a processing unit connected to the sensing unit, the sensing unit has a CCD camera, and the 
processing unit is connected to a picture memory serving to store pictures, a sound memory to 
store sounds, and a loudspeaker suitable for emitting acoustic signals. 

Related Art 

There are many types of [device] devices today that aid the blind [to move] in moving 
aboutf.] . Of [of] these^ there is the stick, the disadvantage of which is that the sensing distance 
is small. A significant aiding partner is a trained guide dog, the acquisition and keeping of 
which is very expensive. The general deficiencies of the known aiding devices are that they do 
not give information regarding the pictures and the direction of the obstacles, only [of] their 
presence. 
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The software that is available commercially is capable of producing a relationship 
between pictures and sounds, but it requires a great deal of hardwar e. Thus, [so] because of 
its dimensions and high price^ it will not become a mass produced article. [Due to the 
development of microchips development engineers are provided with microprocessors with a 
high operating speed and a large memory capacity in a sufficiently small size, cheaply, and they 
can be programmed as required, so they may become mass produced articles, like for example, 
the hearing aid.] 



Installed and portable devices are also known and have an image sensor and 
loudspeakers which are connected to a portable or PC-tvpe computer. With the help of the 
computer the signals from the image forming CCD camera (that is. the sensed images) can be 

Q recorded and appropriate acoustic signals (specificallv their names) can be linked to the 

O 

individual images. The blind use these devices in such a way that, in the case of the recognition 
2i of pictures formed of objects positioned in a given area, the device broadcasts the name linked 

CI to the image from the loudspeaker, so that the blind are able to acquire information about the 

a objects in their environment. Such a solution is described in the text of Masato Kawado's 

rl 

n lecture entitled "Image Understanding for Navigation Support" flFuzzv Svstem International 

P Conference. US. New York. IEEE 20/03/1995. pages 29-30: XP 000699268^ 
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The disadvantage of the solution described in this lecture, however, is that the svstem 
that helps orientation is constructed of components with large dimensions, so that it cannot be 
used practically when the blind person is moving, for example, on the street or on a stairwav. 

Another unfavourable aspect is that the equipment onlv gives answers to questions 
asked bv the person using it. In other words, it does not carrv out automatic navigation, and it 
is onlv able to state whether certain objects are in the vicinity and possibly their position. 

A further disadvantage is that, due to the larger dimensions, the loading of the image 
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memory of the device is difficult, and picture and sound recording while in motion may only be 
carried out in a very complex manner. 

Another of the disadvantages of the device is that the fixed position camera does not 
give the appropriate navigation possibility for the blind person moving about, so the positions 
of the objects in the vicinity are difficult to determine for a person in motion. 

Summary of Invention 

With the invention^ our aim [was] is to overcome the deficiencies of the known aiding 
^ devices and to create a device that supports the picture creating ability of the blind and so 

O improves their sureness of movement and aids better and more precise orientation of blind 

PI 

persons when moving, even in traffic, and while moving in other otherwise unknown outdoor 
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areas. 



Our aim [was] is for the device to be small and for its production cost and selling price 
to allow it to be sold as a mass produced article. 

The basis of the idea of the invention was formed by the recognition that^ [if] with the 
help of an optical device fixed to the head and capable of producing pictures of objects, and of 
comparing these with the pictures of groups stored earlier in a database [with the help] by 
means of a computing device^ [we select] a sound identifier that [the] most closely relates to 
the object is selected and [this] is played to the blind person in an audible for m. In this manner. 
[then] the task of carrying out the simple picture-sound transformation [the task may become] 
becomes solvable. 

We recognised that, due to the development of microchips, high operating speed 
microprocessors and large memory capacity provide development engineers with cheap. 
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flexible programmabilitv in a sufficiently small size. Because of this, the implementation of 
simple picture-sound transformation may be solved with structural elements of a small size that 
may be placed on the head of blind people, specifically on spectacles-like carrying devices, and 
in this way, the device becomes a mass produced article, just like hearing aids, for example. 

[In accordance with the set aim the device according to the invention to aid the 
orientation of the blind - which contains a sensing unit fixed to the body surface of the person 
using it and processing unit connected to the sensing unit - is formed in such a way that the 
sensing unit has a CCD camera and the processing unit has a microprocessor, the 
microprocessor has an analogue input, external bus and output, through the signal forming unit 
of the camera it is connected to the analogue input of the microprocessor, picture memory and 
sound memory is connected to the external bus of the microprocessor, and with the 
O implementation of an amplifier a loudspeaker suitable for transmitting speech information is 

iQ connected to the output of the microprocessor.] 

m 

W In accordance with the set aim, the equipment to aid the orientation of the blind 

r| contains a device attached to a carrying unit that can be attached to the surface of the body and 

an input unit that can be connected to the device. The device has a sensing unit and a 
4^ processing unit connected to the sensing unit, the sensing unit has a CCD camera, and the 

lli processing unit is connected to a picture memory serving to store pictures, a sound memory to 

store sounds, and a loudspeaker suitable for emitting acoustic signals. The device is formed in 
such a way that the unit carrying the device has spectacles that can be positioned on the head 
of the person using it, the sensing unit's camera is fixed to the spectacles, and furthermore, the 
processing unit is a small sized microprocessor with an analogue input, an external bus and an 
output. The processing unit has a joining module, and the camera is connected to the analogue 
input of the microprocessor through the joining module. The picture memory and the sound 
memory are connected to the external bus of the microprocessor and with the insertion of an 
. amplifier, the loudspeaker is connected to the output of the microprocessor. 
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[A further criterion of the device according to the invention is that the microprocessor 
has a data transfer input, and through a recording unit temporarily connected to the data 
transfer input a microphone is connected serving to read in verbal information.] 

A further criterion of the set of equipment according to the invention is that the 
microprocessor, the joining module, the picture memory, the sound memorv, the amplifier and 

the loudspeaker are fixed to the spectacles. 

In a possible version of the set of equipment, the microprocessor has a data transfer 
input the writing unit has a microphone for reading in verbal information, the writing unit is 
temporarily connected to the data transfer input, and the microphone is temporarily connected 
to the data transfer input of the microprocessor. 

In a [possible] further version of the [device] set equipment , the microprocessor has a 
controller part unit suitable for reading in and processing picture and sound information at the 
same time, the controller part unit is connected to the internal memory unit serving as a store 
for the picture information and to a second internal memory unit serving as a store for the 
sound information, and the two internal memory units are connected to an identifying unit 
[serving the] for searching according to picture information^ and also [serving to connect up] 
for connecting the picture and sound information. 

The [device] set equipment has numerous advantageous features. An important 
advantage is that^ in the brain of a person blinded in an accident^ there is a kind of "picture" of 
the environment and the world, and so it is easier to give back the concrete pictures of the 
objects in their area of movement, in the area of his/her home^ and in the neighbourhood by 
naming them. 



Those born blind participate in different training processes[,] where^ with the help of 
touch, feel and explanation^ they carry the visible pictures of only a few objects and situations, 
and so for them the advantage of the device is [that] in making use of its free programming 
ability so that so-called global pictures can be produced in accordance with the person's 
"vocabulary". 

[A favourable point is that due to the transformation of new picture information to 
sound information recognising, identifying obstacles occurring while moving about as pictures, 
then playing them as sound, the device guarantees a much better feeling of security than the 
already realised bleeper, signalling devices.] 

A favourable point is that, due to the transformation of picture information to sound 
information in a new wav and the emplovment of equipment of small size, recognising and 
identifying obstacles occurring while moving about as pictures, and then playing them as sound 
by means of the device guarantees a much better feeling of safety than the already realised 
bleepen signalling devices, and the essentially non-portable, image recognition communications 
devices. Thus, the invention makes it possible for blind people to move about essentially freely, 
even in an unknown environment. 

Another advantage is that^ on the one hand^ [that] the picture and word vocabulary of 
the device is programmed in a fixed way during manufacture, and on the other hand^ [that] a 
seeing person in the environment of the person using the device can carry out customised 
programming, so that the device can become language independent and be simply used 
anywhere in the world. Due to the dimensions and the use of the unique recording unit, it mav 
be programmed, even while in motion. 

Another favourable feature is that the information stored in the device does not use the 
"usual: bmp, jpg, ..." picture storage procedures, but its unique resolution is low (64x8 bit is 
one picture), so that, due to the small amount of space required^ the upper limit of the number 



of pictures that can be stored is only a question of memory capacity, and it is possible to 
produce cheaper, more modest one hundred word devices, or more expensive devices 
containing even one thousand picture word connections. 

Due to the low resolution^ an advantage is that many [different] objects which are 
different in some respects, but which are similar in profile^ are forced into one group, but the 
aim is not to recognise a type, or the brand of a motor vehicle, so that differentiating is 
satisfactory. 

Another advantage that has to be mentioned is that the weight of the device is low, as 
is its consumption, its price is modest, affordable by all, its covering is protected against rain, 
its sensitivity even in dusk is satisfactory, [as] and it ensures stable operation even in 
environmental light of 0.2 lux. 

It is also important to emphasise the advantageous feature that technically a resolution 
may be attained with which letters[,] and characters may be "read ouf , and with this a new 
area of use opens, not only for the blind, but also for those with poor sight. 

Another advantage is that the device does not operate by answering questions, but 
operates in every case when an object comes into the field of vision of the camera, and this 
ensures automatic navigation for blind people. Still another important advantage is that due to 
the positioning of the camera on the head, in a spectacle frame, the blind person receives 
information on the objects in front of him/her in a band according to the position of the bodv. 
that is, the head, which even in the basic position essentially makes the position of obstacles 
with respect to the position of the blind person perceivable. 



It is practical for the device of the set equipment to be fitted to the arms of a spectacles 
frame (also ensuring its aesthetic production) so that, in accordance with the head movement- 



seeing psychological effect^ it is turned in the direction of "viewing" and so the optical sensor 
of the device fixed in this way sees a real, black and white picture. A microcomputer 
transforms the produced [signal] series of signals into digital form with [AD] analogue-to 
digital conversion, stores it, and then compares it with the bit pictures of signal forms 
belonging to an average of one hundred pictures recorded during programming. In accordance 
with the result of the comparison^ an expression is selected that was associated with the picture 
during programming^ and the name of the picture is read out through miniature loudspeakers. 

Brief Description of Drawings 

In connection with the example the invention is presented in more detail on the basis of 
drawings[. On the drawing] in which: 

Figure 1 is [the] an outline sketch of a version of the device. 

Figure 2 is a picture showing the video signal mapping, and 

Figure 3 is [the] a flow [block] diagram of the steps of the operating program. 

Disclosure of Invention 

Figure 1 shows the outline of the important elements of the device. The CCD camera 1 
provides the basic signal of the device, which the joining module 2 edits and adjusts in 
amplitude for the microprocessor 3 having an external bus 3b . 

The sample-taking subroutine of the processing program stores the video signal coming 
into the analogue input 3 a of the microprocessor 3 in 64 pieces, 8 bit words - as shown in 
[figure] Figure 2 - as one block in the working register. This low resolution gives the device 
the advantage that it sees quite a lot of similar objects to be the same. The procedure can 
continue here in two directions. 



In the case that we are in the "learning" status, [in other words] we connect the writing 
unit 8 temporarily to the data transfer input 3d of the microprocessor 3 and then it writes the 
contents of a given block into the picture memory 4, and provides it with a serial number[,] 
which it then uses as an index during the search process. At the same time^ it stores the short 
describing expression arriving through the microphone 9 into the sound memory 5. 

If we are in the recognition or user status, the program - the block outline of which is 
shown by [figure] Figure 3 - takes the blocks fi"om the picture memory 4 in line, compares 
them with the blocks to be found in the working register, and then^ in the case of [sameness] 
identity on the basis of the index belonging to the given blocks the expression belonging to the 
index is selected fi'om the sound memory 5, transferred to the output register, and then "sent" 
out through the output 3c to the amplifier 6, and then to the loudspeaker 7. The process is 
repeated like this, and then^ if there is no identifiable blocks a message "unknovra obstacle" is 
heard. In the interest of reliable identification the picture needs to be a standing picture for one 
second[!]i 

Deriving from the video signal fi-equency and the type of microprocessor and its clock 
pulse (100 MHzX [approx,] a pproximately ten [measurement] measurements take place in one 
second, and this is enough of a guarantee for reliable recognition. This value is close to the 
human recognising ability, e.g. the running into one another of pictures while you shake your 
head. 

While preferred forms and arrangements have been shown in illustrating the invention, 
it is to be understood that various changes and modifications mav be made without departing 
from the spirit and scope of this disclosure. 
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[List of references 



1 camera 

2 joining module 

3 microprocessor ' 3a analogue input 

3b external bus 
3c output 

3d data transfer input 

4 picture memory 

5 sound memory 

6 amplifier 

7 loudspeaker 

8 writing unit 

9 microphone] 
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MARKED UP COPY OF AMENDED ABSTRACT 



[The invention relates to a] A device to aid in the orientation of the blind[, which 
contains] comprises a sensing unit fixed to the body surface of the person using it and a 
processing unit connected to the sensing unit. The characteristic feature of the [solution] 
invention is that the sensing unit has a CCD camera (1) and the processing unit has a 
microprocessor (3), the microprocessor (3) has an analogue input (3a), an external bus (3b) 
and an output (3 c), and through the signal forming unit (2) of the camera (1)^ it is connected to 
the analogue input (3a) of the microprocessor (3)[,]^ A picture memory (4) and a sound 
memory (5) [is] are connected to the external bus (3b) of the microprocessor (3), and with the 
implementation of an amplifier (6)^ a loudspeaker (7) suitable for transmitting speech 
information is connected to the output (3c) of the microprocessor (3). 



